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ANALYSIS OF LARGE UNRELIABLE STOCHASTIC NETWORKS 
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Abstract. In this paper a stochastic model of a large distributed system 
where users’ files are duplicated on unreliable data servers is investigated. 
Due to a server breakdown, a copy of a file can be lost, it can be retrieved if 
another copy of the same file is stored on other servers. In the case where no 
other copy of a given file is present in the network, it is definitively lost. In 
order to have multiple copies of a given file, it is assumed that each server can 
devote a fraction of its processing capacity to duplicate files on other servers 
to enhance the durability of the system. 

A simplified stochastic model of this network is analyzed. It is assumed 
that a copy of a given file is lost at some fixed rate and that the initial state is 
optimal: each file has the maximum number d of copies located on the servers 
of the network. The capacity of duplication policy is used by the files with 
the lowest number of copies. Due to random losses, the state of the network is 
transient and all files will be eventually lost. As a consequence, a transient d- 
dimensional Markov process (A (f)) with a unique absorbing state describes the 
evolution this network. By taking a scaling parameter N related to the number 
of nodes of the network, a scaling analysis of this process is developed. The 
asymptotic behavior of {X{t)) is analyzed on time scales of the type t i-A- N^t 
for 0 < p < d—1. The paper derives asymptotic results on the decay of the 
network: Under a stability assumption, the main results state that the critical 
time scale for the decay of the system is given by t i-A- In particular 

the duration of time after which a fixed fraction of files are lost is of the order 
of . When the stability condition is not satisfied, i.e. when it is initially 

overloaded, it is shown that the state of the network converges to an interesting 
local equilibrium which is investigated. As a consequence it sheds some light 
on the role of the key parameters A, the duplication rate and d, the maximal 
number of copies, in the design of these systems. The techniques used involve 
careful stochastic calculus for Poisson processes, technical estimates and the 
proof of a stochastic averaging principle. 
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1. Introduction 


1.1. Large Distributed Systems. In this paper the problem of reliability of large 
distributed system is analyzed via mathematical models. A typical framework is 
a cloud computing environment where users’ files are duplicated on several data 
servers. When a server breaks down, all copies of files stored on this server are lost 
but they can be retrieved if copies of the same files are stored on other servers. In 
the case where no other copy of a given file is present in the network, it is definitively 
lost. Eailures of disks occur naturally in this context, these events are quite rare 
but, given the large number of nodes of these large systems, this is not a negligible 
phenomenon at all at network scale. Eor example, in a data center with 200 000 
servers, in average five disks fail every day. See the extensive study Pinheiro et 
al. [1^ in this domain at Google. A natural consequence of these failures is the 
potential loss of some files if several servers holding copies of these files fail during 
a small time interval. Eor this reason this is a critical issue for companies deploying 
these large data centers. 

Duplication Policies. In order to maintain copies on distant servers, a fraction 
A of the bandwidth of each server has to be devoted to the duplication mechanism 
of its files to other servers. If, for a short period of time, several of the servers 
break down, it may happen that files will be lost for good just because all the 
available copies were on these servers and because a recovery procedure was not 
completed before the last copy disappeared. A second parameter of importance 
is d the maximal number of copies of a given file in different servers. The general 
problem can then be presented as follows: On the one hand, d should be sufficiently 
large, so that any file has a copy available on at least one server at any time. On 
the other hand, the maximum number of copies for a given should not be too large, 
otherwise the necessary fraction of the server capacity for maintaining the number 
of copies would be very large and could impact other functions of the server. 

1.2. Mathematical Models. The natural critical parameters of such a distributed 
system with N servers are the failure rate ^ of servers, the bandwidth A allocated to 
duplication and the total number of files iW. To design such a system, it is there¬ 
fore desirable to have a duplication policy which maximizes the average number of 
files P = Fm/N per server and the first instant Tn{6) when a fraction 6 G (0, 1) of 
files is lost. The main goal of this paper is to give some insight on the role of these 
parameters through a simplified stochastic model. 
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A lot of work has been done in computer science concerning the implementa¬ 
tion of duplication algorithms. These systems are known as distributed hash tables 
(DHT). They play an important role in the development of some large scale dis¬ 
tributed systems, see Rhea et al. [50] and Rowstron and Druschel [55| for example. 

Curiously, except extensive simulations, little has been done to evaluate the 
performances of these algorithms. Simplified models using birth and death processes 
have been used. See Chun et al. |1], Picconi et al. m and Ramabhadran and 
Pasquale [TH] . In Feuillet and Robert |0] , a mathematical model of the case of c?=2 
copies has been investigated. In |0], the main stochastic process of interest lives in 
dimension 1 which simplifies somewhat the analysis. As it will be seen, in our case, 
one has to investigate the more challenging problem of estimating some transient 
characteristics of a d—1-dimensional Markov process. 

To the best of our knowledge, there has not been any mathematical study inves¬ 
tigating the dependence of the decay of the network, represented by the variable 
Tjv((5), with respect to the maximal number of copies d and j3 the average number 
of files per server. As it will be seen, even with a simplified model of the paper, 
the problem is already quite challenging. One has to derive estimates of transient 
characteristics of a transient d-dimensional Markov process on with a reflection 
mechanism on the boundary of the state space. 

A Possible Mathematical Model. Without simplifying assumptions, a math¬ 
ematical model could use a state descriptor {Yj{t),l < j < Tn), where Yj{t) is 
the subset of {1,..., A^} of servers having a copy of file j at time t. Note that the 
cardinality of Yi{t) is at most d and that file i is lost if Yi{t) = 0. The transitions 
can be described as follows. 

(1) Loss: If, for 1 < J < Af, node i breaks down in state (Yj) then the value of 
Yj does not change ii i ^Yj and, otherwise, Yj >->• l^\{z}. 

(2) Duplication: if 1 < ii ^ 12 < N and 1 < j < Tat are such that \Yj\ < d, 
ii G Yj and Z 2 ^ Yj, if the duplication policy at node ii does a copy of j 
at 12 , then Yj i-G Yj U {i 2 } and the other coordinates are not affected by 
this change. Depending on the duplication policy at node ii, the choice of 
the node 12 and of file j to copy may depend in a complicated way of the 
current state {Yj). 

As it can be seen the state space is quite complicated and, moreover, its dimension 
is growing with N which is a difficulty to investigate the asymptotics for N large. 
It does not seem to lead to a tractable mathematical model to study for example 
the first instant when a fraction S G (0, 1) of files are lost. 



inf < t > 0 : ^ l{Yj(t)= 0 } > SFn 


1 


Simplifying Assumptions. We present the mathematical model to be studied. 
The model has been chosen so that the role of the parameter d on the decay of 
the network can be investigated. To keep mathematics tractable, simplifications 
for some of the other aspects of these systems have been done. We review the main 
features of our model and the assumptions we have done. 

(1) Capacity for duplication. 

If there are N servers and each of them has an available bandwidth A to 
duplicate files, then the maximal capacity for duplication is \N. One will 
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assume that the duplication capacity can be used globally, i.e. the rate at 
which copies are created is XN. 

(2) Duplication Policy. 

Moreover, the duplication capacity is used on the files with the lowest num¬ 
ber of copies. The duplication capacity is in fact used at best, on the files 
that, potentially, are the most likely to be lost. 

(3) Failures. 

Any copy of a given file is lost at rate fi. With this assumption, failures 
are more frequent but only a copy is lost at each event. In a more realistic 
setting, when a server breaks down, copies of several different files are lost 
at the same time. 

(4) Topological Aspects. 

In practice, in DHT, servers are located on a logical ring and, in order to 
limit the communication overhead, the location of copies of a file owned by 
a given server i are done at random on a fixed subset Ai of nodes, the leaf 
set of i. In our model, we assume that Ai is the whole set of servers. 

(5) Statistical Assumptions. 

For mathematical convenience, the random variables used for the duration 
between two breakdowns of a server or of a duplication of a hie are assumed 
to be exponentially distributed. 

For this simplihed model, the use of the total capacity of duplication is optimal, 
see items (1) and (2) below. Our results gives therefore an upper bound on the 
efficiency of duplication mechanisms in a general context. 

The Corresponding Markovian Model. With our assumptions, the state 
space can be embedded in a hxed state space of dimension d + 1. If, for 0 < i < d 
and t > 0, (t) is the number of hies with i copies, then the vector X^{t) = 

{X^(t), X^(t),... ,X^(t)) is a Markov process on 

Transitions. The model starts initially with Fjv hies, each of them having a 
maximal number of copies d, i.e. A^(0) = (0, 0,..., 0, F^v). If X^{t) is in state 
X=(Xi ) € and, for 0 < i < d, Ci is the ith unit vector, there are two types of 

transitions for the Markov process. See Figure 

(1) Loss: for I < i < d, cc —>■ a; + e^-i — e^. 

A copy of a hie with i copies is lost at rate ixifi. 

(2) Duplication: for 1 < i < d, x —>■ x — Ci -h Cj+i, 1 < i < d. 

It occurs at rate XX under the condition xi = X 2 = ■ ■ ■ = Xi-i = 0, which 
means that there are no hies with between 1 and i copies. 

Clearly enough, this system is transient, due to the random losses, all hies are 
eventually lost, the state 0 = (F^r, 0,..., 0) is an absorbing state. The aim of this 
paper is to describe the decay of the network, i.e. how the number X^ {t) of lost 
hies is increasing with respect to time. 

For hxed F/v and iV, this problem is related to the analysis of the transient be¬ 
havior of a multi-dimensional Markov process. In our case, because of rehection on 
boundaries of due to the duplication mechanism, the distribution of the evo¬ 
lution of the Markov process {Xk{t)) is not easy to study. For this reason, a scaling 
approach is used, with N converging to inhnity and F/v being kept proportional to 
N. 
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Figure 1. Jump Rates for transfers of one unit between the co¬ 
ordinates of the Markov Process {X^{t)) in state {xo,xi,... ,Xd) 


It will be assumed that the average number of files per server Fjv /N converges to 
some (3 > 0. For <5 > 0, the decay of the system can be represented by the random 
variable 

r^(<5) = inf > 0 : > J/?! 

the time it take to have a fraction 5 of the files lost. 

1.3. Related Mathematical Models. 

Ehrenfest Urn Models. The Markov process {X{t)) can be seen as a particle 
system with d -I- 1 boxes and any particle in box 1 < i < d moves to box * — 1 at 
rate /r. Box with index 0 is a cemetery for particles. A “pushing” process moves 
the particle the further on the left (box 0 excluded) to the next box on its right at 
a high rate XN. The model can be seen as a variation of the classical Ehrenfest urn 
model, see Karlin and McGregor El and Diaconis et al. [5] for example. 

Polymerization Processes in Biology. It turns out that this model has some 
similarities with stochastic processes representing polymerization processes of some 
biological models. The simplest model starts with a set of monomers (some pro¬ 
teins) that can aggregate to form polymers. Due to random fluctuations within 
the cell, a polymer of size i and a monomer can produce a polymer of size i -I-1 at 
some hxed rate. In this context, as long as the size i of the polymer is below some 
constant fo, the polymer is not stable, it will lose monomers very quickly, at a high 
rate, it breaks into a polymer of size i—1 and a monomer. When the size is greater 
or equal to ig (nucleation phase) the polymer is much more stable, it is assumed 
that it remains in this state. Again due to the random fluctuations, all particles will 
end up in polymers of sizer greater than zg. These “large” polymers correspond to 
our box 0 for the duplication process and the monomers are the equivalent of files 
with d copies. The lag time is the first instant when a positive fraction (half say) of 
the monomers have been consumed into stable polymers. Note that it is analogous 
to our T]\[{l/2). In this framework, the fluctuations of the lag time have important 
consequences on biological processes. See Prigent et al. [H], Xue et al. [57] and 
Szavits-Nossan et al. |5^ for example. 

1.4. Presentation of the Results. The model starts with Fn ~ j3N files, all of 
them with the maximum number of copies d. The loss rate of a copy is fj, and the 
duplication rate is XN but only for the files with the minimum number of copies. 
For 0 < i < d, X^ {t) denotes the number of files with i copies. 
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It is first shown in Theorem [T] that, as N gets large, for the convergence of 
stochastic process 


( 1 ) 


lim 


N—*--\-oo 



,0 < k < d 


{xk{t), 0 < k < d). 


The limit {xk{t),0 < k < d) can be expressed as the solution of a deterministic 
generalized Skorohod problem. See Section]^ for the definition. 


Stable Case: A > d^p. 

With the resolution of the generalized Skorohod problem, Proposition[2of Section]^ 
one proves that if A > d^l3 then the network is stable in the sense that the limiting 
process {xk{t),0 < k < d) is constant and equal to (0,..., 0, /?). In other words, on 
the normal time scale, the fraction of lost files is zero and, at the fluid level, all files 
have the maximal number of copies d. 

The key results of the stable case are Theorem of Section and Theorem 
of Section . These quite technical and delicate results rely on careful stochastic 
calculus and various technical estimates related to the flows between coordinates 
of the process {X^{t)). They are proved in several propositions of Section]^ the 
important Proposition in particular. A stochastic averaging result completes the 
proof of these difficult convergence results. 

Theorem shows that the network is in fact beginning to lose files only on the 
time scale t i-A i.e. that the convergence in distribution 


( 2 ) 


lim 


N—^-\-oo 




= m)) 


where $(<) is the unique solution y G [0,/3] of the equation 


1--) 


p/d 


= exp 




nd-1 


On this time scale, the fluid state of the network evolves from (0,..., 0, /3) to the 
absorbing state: <i>(0) = 0 and $(t) converges to (3 as t goes to infinity. 

The second order fluctuations are described by the convergence in distribution 


lim 

N—^-\-oo 




y/N 


= (Wit)), 


where <I>(t) is the solution of Equation (31) and the process {W{t)) is the solution 
of a stochastic differential equation. Relation (34). 


Overloaded Case: py , l 3 < X < {p + l)/r/3 for some 2 < p < d - 1 . 

In this case, the limiting process { xk { t ),0 < k < d ) oi Relation ([^ is not trivial, 
i.e. different from its initial state (0,0,... ,0,/3). Its explicit expression is given in 
Proposition [2 Moreover, it is shown that 

lim {xpit),Xp+i{t)) = ( (p+ l)/3 - - -pP] . 

*->■+00 p J 


This can be interpreted as follows: In the limit, on the normal time scale, at the 
fluid level all files have either p or p + 1 copies. The network exhibits therefore an 
interesting property of local equilibrium. 

If one starts from this local equilibrium, it is shown that the system begins to 
lose files only the time scale t i-+ A result analogous to Relation is 
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proved by Theorem for the convergence in distribution, 


lim 

AT—>-+oo 


Xi^{NP-H) X^{NP-H) X^+,{NP-H) 


N 


N 


N 


= ($o(i),$pW.^P+iW) 


holds, where (<i>o(Oi‘J’ p+i(^)) is deterministic, with the property that 


lim 

>-+00 


($o(t),^pW,^P+iW) 



i.e. asymptotically all files are either lost or have p + 1 copies. 

These results give the main phenomena concerning the evolution of a stable net¬ 
work towards the absorbing state. It should be noted that we do not consider the 
special cases when the parameters satisfy the relation A=c?/i/3 for the following rea¬ 
son. When A<d/i/3, the analysis involves a stochastic averaging principle with an 
underlying ergodic Markov process. See Section [4^ below. With equality A=d^/3, 
the corresponding Markov process is in fact null recurrent and proving a stochas¬ 
tic averaging principle in this context turns out to be more delicate. There are 
few examples in this domain to the best of our knowledge. See Khasminskii and 
Krylov |12| in the case of diffusions. The same remark applies to similar identities, 
like A = ppP for 1 < p < d. 


Choice of Parameters. As a consequence, the parameters /3 and d should be 
chosen so that \/{j3p) > 2 and d = [A/(/3p)J to maximize the time of decay of 
the network and at the same time to preserve the stability of the network. For 
5 S (0,1) the variable the hrst instant when a fraction 5 of files is lost, is 

then of the order of . 


Outline of the Paper. Section [2] introduces the main notations and the stochas¬ 
tic evolution equations of the network. Section shows that the Markov process 
can be expressed as the solution of a generalized Skorohod problem, presented in 
Appendix]^ A convergence result on the evolution of the network on the normal 
time scale is established and an explicit expression for the limiting process is pro¬ 
vided. Section [^investigates the decay of the network on the time scale t >->■ 
in the stable case. A central limit theorem on this time scale is established in Sec¬ 
tion The overloaded case is analyzed in Section the asymptotic evolution of 
the local equilibrium is studied on several time scales. 


2. The Stochastic Model 

In this section we introduce the notations used throughout this paper as well as 
the statistical assumptions. The stochastic differential equations describing the evo¬ 
lution of the network are introduced. It is shown that, via a change of coordinates, 
the state descriptor of the process can be expressed as the solution of a generalized 
Skorohod problem. See Sectionj^ The convergence results at the normal time scale 
t ^ t proved in the next section use this key property. 

A given file has a maximum of d copies and each of them vanishes after an 
independent exponential time with rate rate p. A file with 0 copy is lost for good. 
The recovery policy works as follows. The total capacity XN of the network is 
allocated to the files with the minimum number of copies. Consequently, if at a 
given time all non-lost files present have at least fc > 1 copies and there are Xk hies 
with k copies, then each of these is duplicated after an independent exponential 
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time with rate XN/xk- Initially it is assumed that there are -FV files and that the 
network starts from the optimal state where each file has d copies. 

For 0 < k < d, X^{t) denotes the number of files with k copies at time t. The 
quantity (t) is the number of lost files at time t, the function t i—)■ X^ (t) is in 

particular non-decreasing. 

The conservation relation Xq {t)+Xi {t)+ ■ ■ ■ +X^{t)=FN gives that the sto¬ 
chastic process {Xq (t), X^(t),..., X^_-^{t)) on has the Markov property. Its 
Q-matrix = {q^{■,■)) is given by 


( 3 ) 


q^{x,x- Cfc -b Ck-i) 
q^{x,x + ed-i) 
q^{x,x + Ck - ek-i) 
q^{x,x- ed-i) 


= nkxk, 1 < k < d — 1, 

= ^id {Fn - xo- xi - Xd-i), 

= AA^]l|a;^_^>Q 3;^—o,i<i<fc—1}5 ‘1 Fi k Fi d 1, 


where is the /cth unit vector of The first two relations come from the 

independence of losses of various copies of files, note that F/v — xq — a;i — -- Xd-i 

is the number of files with d copies. The last two equations are a consequence of 
the fact that the capacity is devoted to the smallest index k>l such that Xk ^ 0 . 
The coordinate X^ {t) is of course given by 


X^it) = Fm- X^{t) - x^it) - x^_,it), 


X^ (t) is the number of files with the maximal number d of copies at time t. The 
initial condition is such that X^{Q) = 0ior0<k<d—1 and X^(0) = Fn G N. 


Scaling Condition. It is assumed that there exist some /3 > 0 and 7 > 0 such 
that 


( 4 ) 



Fn-Ni3 

y/N 


Equations of Evolution. To analyze the asymptotic behavior of the process 
{X^{t)), it is convenient to introduce the processes {t))={{S^ (t), l<A:<d—1)) 
and {t))={{R^{t),l<k<d—l)). For 1 < fc < d — 1 and t > 0, (t) is the 

number of files with no more than k copies at time t and R^ (t) is the local time 
at 0 of the process (S'^(t)), 

Sk (t) = and R^(t) = j du. 

For any function h G I?(M+,M+), i.e. h is continuous on the right and has left 
limits on IR+, one denotes by Nu denotes a point process on IR+ defined as follows 

(5) JVhi[0,t])= [ Vi[0,hiu-)]xdu) 

Jo 

where hiu—) is the left limit of /i at u and F is a Poisson process in whose 
intensity is the Lebesgue measure on In particular if h is deterministic, then 
Afh is a Poisson process with intensity {h{t—)). When several such processes J\fh are 
used as below in the evolution equations, then the corresponding Poisson processes 
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V used are assumed to be independent. The equations of evolution can then be 
written as, 

for 1 < fc < d — 2, with the convention that {Sq (t)) = 0 is the null process and 
also that {Ro{t)) = (t). By integrating and compensating these equations, one gets 
that 

(6) S^{t) = Z^{t)-XN{Rt,{t)-R^{t)), l<k<d-l, 
and the first coordinates {X^(t)) satisfies the relation 

/•* 

(7) 


X^{t)=txf S^{u) du + U^{t), 
Jo 


with 


= d/i f [Fn - S^_,{u) - X^iu)] du-fi f S^iu) du + Ul,{t) 
Jo Jo 

z^it) = {k+ l)/i - S^{u)) du-n f S^{u) du + U^{t), 

Jo Jo 


for 1 < fc < d — 2, where the {U^{t)) = 1 < k < d—1) are the martingales 


associated to the jumps of these processes, for 1 < fc < d — 2, 

rt . 
tN 


Ukit)= / [A7^(fe+i)x,« , (du) - Kk + O^k+i (u) du 
0 

rtr . rt 


(du)-/xXf (u) du 


~ / ^{sf_i(«-)=o.sf («-)>o} [A7AN(du)-AiVdw], 

^ yj JO 

and its increasing process is given by 

(8) (C/f)(t) =M(fc+l) / ^l^i(u) dM + /x / X^{u)du 

Jo Jo 

The martingales {U^{t)) and have similar expressions, 

Ud-iit) = [ [ACi^(F„-s«_,-A«)(du) - d^liFN-S^_^{u)-X^(u)) du 


/o ^ 


rt r 


(du)-AiXf (wjduj - l{s«_^(„_)=o,s«_i(«-)>o} [-^>Af(du)-AiVdM] 


with 


{U^_,) (t) = dAi f {Fr,-S^_,{u)-X^{u)) du 
Jo 

lo ^{s«_ 2 («-)=o,s«_i(«-)>o} du, 
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and 


^0 (i) = / (du) — dw, with (^U^) (t) = ^ (u) du. 


'0 


A Generalized Skorohod Problem Representation. For h = (hi) an element 
of r] > 0 and F G N, denote 


(9) 


Gi{h, F,T]){t) = f (2/12(11) — 3/ii(u)) du — T]t, 

J^t 

Gkih,F,ri){t) = n f {{k + l)hk+i-{k + l)hk{u)-hi{u))du, l<k<d-l, 

Jo 

pt r pu 1 pt 

Gd-i{h, F,ri)(t) = dfi / F—hd-i{u)—fi hi{v)dv du—fj, / /ii(it)du, 

. JO L Jo J Jo 

and G{h,F,r]) = {Gk{h, F,r]),l < k < d — 1). Equations ^ and Q give the 
relations 


(10) S^{t) = G{S^,FN,XN){t) + U^{t) 

-dfi [ U^iu) dit • Cd-i + XN{I - P)R^it), 

Jo 

where P is the matrix P = {Pij, 1 < i, J < d — 1) whose non zero coefficients are 
the Pid-i = 1 for 2 < 1 < d — 1. 

In other words, for a fixed A, the couple {S^, XNR^) is the solution of the 
generalized Skorohod problem associated to the matrix P and the functional 

( 11 ) G-.h^G{h,FN,XN) + U^-dfi [ U^{u) du-Cd-i- 

Jo 

See the appendix for the definition and a result of existence and uniqueness. 


3. First Order Asymptotic Behavior 


In this section, the asymptotic behavior of the sequence of processes {X^{t)/N) 
at the “normal” time scale is investigated. As a consequence, it is shown that if 
A > Pdfi then the network is stable at the fluid level, i.e. the fraction of lost files is 
0 at any time. Otherwise, a positive fraction of hies is lost, an explicit expression 
for this quantity is provided. 

More precisely the convergence of the sequence of stochastic processes 




(t) 


N 


0 < k < d 


is investigated. One hrst shows that this sequence is tight and the limit is identi- 
hed as the solution of a deterministic generalized Skorohod problem. An explicit 
computation of this limit concludes the section. 


Tightness. Due to Assumption Q, there exists some constant Gq such that the 
relation F]\j < GqN holds for all N. Since 0 < X^{t) < F/v for any 0 < fc < d — 1 
and t > 0, Relation Q gives the existence of a constant Ci such that 

(12) E = E (([/f) (t)) < Cl At, VI < fc < d - 1 and t > 0. 
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with Doob’s Inequality one gets that, for 1 < /c < d — 1 and e > 0, 


Ukis) 

sup \ > £ 1 < 

0<s<t 


1 


(eNy 


mkm< 


Cit 


shows that, for 0 < fc < d — 1, the martingale {U^it)/N) converges in distribution 
to 0 uniformly on compact sets. 

For T > 0, <5 > 0 and for Z a function in the space K) of cadlag functions, 

i.e. right continuous functions on IR+ with left limits at every point, define wz{5) 
as the modulus of continuity of the process {Z{t)) on the interval [0,T], 

(13) wz{S) = sup \Z{t)-Z{s)\. 

0<s<t<T, |t-s|<5 

By using again the relation X^{t) < CqN for all iV G N, 1 < A: < d — 1 and t > 0, 
the above equations and the convergence of the martingales to 0 give that, for any 
£ > 0 and f] > 0, there exists d > 0 such that 


V{wgN/]y{6) > ly) < £, P(wj 5 fN/Ar(d) >??)<£, ViV and 1 < A: < d — 1. 

This implies that the sequence of stochastic processes 

is tight and that any of its limiting points is almost surely a continuous processes. 
See Billingsley [ 2 ] for example. 


Convergence. Let {xo{t), (sk{t),l < k < d — 1)) denote a limiting point of the 
sequence (Xq ^ {t)/Np, S^p{t)/Np) associated to some non-decreasing subsequence 
(Np). By choosing an appropriate probability space, it can be assumed that the 
convergence holds almost surely. By Equation Q, one gets that 


xo{t)=f^ si{u) du, 
Jo 


From Definition (11) of the functional G and by convergence of the sequence of 
processes {XQ^{t)/Np,S^p(t)/Np) and of the martingale (M^p/Np) to 0 , one gets 
that the convergence 

hm {S^p , Fv,, XNp) = G {S, /3, A) 

p-^+oo l\p 

holds uniformly on compact sets, where G is defined by Relation As it has 
been seen in the previous section. Equation ( |Io| ), the couple {S^/N, /N) is the 
solution of a classical Skorohod problem associated to the matrix P introduced 
in Equation (10) and the free process {G{S^p, XNp)/Np. By continuity of 


the solutions of a classical Skorohod problem, see Proposition 5.11 of Robert [2T] 
for example, one concludes that {S^/N,R^) converges to the solution (S', i?) of 
the Skorohod problem associated to P and h i-A- G{h,l3,X). Hence (S, i?) is the 
unique solution of the generalized Skorohod problem for the matrix P and the 
functional h G{h,l3,X). The convergence of the sequence {S^/N,Xq /N) has 
been therefore established. 
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Theorem 1. If S(t) = {sk{t), 1 < k < d—1) is the unique solution of the generalized 
Skorohod problem associated to the matrix P = (l{(i,j)=(Li-i)}, 1 < i,j < d — 1) 
and the functional h i-A G{h,l3,X) defined by Equation then the sequence of 
processes 




converges in distribution uniformly on compact sets to (xk{f)) defined by 

Xo{t) = p, si{u) du, xi{t) = si{t), 

JO 

Xk{t) = Skft) - Sk-i{t), 2 <k < d - I, 


Xd{t) = 13- Sd-i{t) - Xo{t). 


If the limiting processes is uniquely determined as the solution of a Skorohod 
problem, it is not always easy to have an explicit representation of the solution 
of a Skorohod problem. The classical example of Jackson networks, see Chen and 
Mandelbaum [3], shows that this is not always easy to have an explicit expression 
for the solutions of these problems in dimension greater than 2. The linear topology 
of the network simplifies this question as the following proposition shows. 


Proposition 1 (Characterization of fluid limits). 

(1) 2p,/3 < X < dp,f3. 

Let p = [p//3J with p = X/pL. the fluid limits {s{t)) = {si{t),Sdft)) of 
Theorem^are defined as follows. There exist a sequence (tk), 

0 — tfi ^ tfi_\ < ■ ■ ■ < ^p+i ^ I'p — oo^ 


such that, for all I = d — 1,... ,p and for < t < ti, 

Skft) =0, 1 < k < l—l, 

si{t) = {I + l)/3 — p + + J2i=i+2 

; + 1 < fc < d. 


^ rvj -e ipt 

=k+l 


Skit) =/3(i-El 

where ad,d = 1 cind, for j > Z+1 


aij = 7TY^“'+iJ> “'J+i = j 1 _ ^ ^ apke 


— kiiti 


sti ~ j — 1 


6,1 — — ( (^ +1)^ — p+ ^ 6,j 




3=1+2 


with api =0 and U is the unique solution of sflt) = X/{lp). 


(2) A > dpj3. 

For all t > 0, (xift), ..., Xd{t)) = (0,..., 0, fl). 

Proof. The vector {sk{t)) is solution of the following equation: 

Sk{t)=p{k + 1) {sk+i{u) - Sk{u))du-p si{u)du-X{rk-i{t)-rk{t)), 
Jo Jo 

Sd{t) =13- psflu) du, 

Jo 





ANALYSIS OF LARGE UNRELIABLE STOCHASTIC NETWORKS 


13 


where the {rk{t)) are the reflection processes such that 


/ Sfc(w)drfc('u) = 0 . 

Jo 

By uniqueness of the solution of a generalized Skorohod problem given by Propo¬ 
sition]^ of the Appendix, it is enough to exhibit a solution to the above equations. 

We assume the conditions of the case (1) of the proposition. We will prove in 
fact that there exists td = 0 < td-i < td -2 < • • ■ < tp < tp_i = -|-oo such that, for 
all p < ^ < d — 1 and ti+i < t < ti, the Sk and the tk have the following equations: 

1< k<l-2. 


(14) 


Sk{t) = 

0 , 

Tkit) = 

t, 

Si-i{t) 

= 0 , 

h-lit) 

= 

Slit) = 

pH + i)si+i{t) - psi{t) - A, 

Hit),= 

0 

hit) = 

p(fc - 1 - l)(Sfc+l(t) - Skit)), 

Tkit) = 

0 , 

Sdit) = 

p, 

fdit) = 

0 . 


l + l<k<d-l, 


The tk are defined such that Sk{tk) = A/(pfc). 

We start with the case d—1. It is easy to check that ((s^), {vk)) defined by the 
following equations is the solution of the generalized Skorohod problem, 


Sfc(t)=0, rk{t)=t, 

Sd -2 = 0 , rd-2{t)=t- 


for 1 < fc < d — 3 
(d-l)p '■* 


A 


/ Sd_i(M)du, 
^0 


Sd_i(t) = (d/3 - A/p) (1 - e ^*), rd-i{t)=Q. 
This is valid for all 0 < t < td-i with 


td-i = - log 
d 


dp- p 


dp-dpl{d-l), 

Now, we proceed by using a recursion. Assume that there exists I > p such that 
the system of equation (14) is verified until ti. Moreover, we assume that, for all 
k > I and tk < tk-i, 


Sk 


(^) = ^ 1- E 




—flit 




and 


Sk-i{t) = kp - p + ^k-i,ie E 


— flit. 


i-k-\-l 


and tk-i is the only solution of 

Sfc-l(tfc-l) = 

We define 


A 


(fc - l)p' 


= , E ^ - Cti+id, ioT d> i > I + 1, 


l + l-i 


api+i = 


pi 


- E 

^ k^l-\-2 


— kfiti 


Cz-1,2 = r- 7(^1,i^ for d > z > / + 1 , 

i — I 
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6-1,1 = - P/3-P+ E 6-1, 

V i=l + l 

It is easy to check that si is then solution of the equation 

Si = pi{l + l)(s;+i(t) - Si{t)) 
when t > ti and si-i is the solution of the equation 

si-i{t) = ^J.lsl(t) - /is/_i(t) - A, 
when ti-i is the solution of the equation 

The recursion is proved and therefore the assertion of case (1) of the proposition. 
Concerning the case (2), one has only to check that the couple 

{xi{t),...,Xd{t)) (0, ...,0,/3) 

(ri(t),..., rd-2{t),rd-i{t),rd{t)) ‘^= (t,..., t, (1 - dn/3/X) t, 0 ) 
is indeed the solution of the generalized Skorohod problem. □ 



The following corollary shows that in the overloaded cases, asymptotically, there 
is an equilibrium where most of files will have either p or p + 1 copies for some 
convenient p. This situation is investigated in Section 

Corollary 1 (Stable Fluid State of the Overloaded System). In the case (1) of 
Proposition^^ then 

lim {xp{f),Xp+i(f)) = ((p+l)/3-p,p-p/3). 


and Xfe(t) —)■ 0 as t ^ +c» for all 1 < k < d, k ^ {p,p + 1}. 

Example. To illustrate the results of Proposition [T] one considers the case d = 4 
and with the condition 2/3/i < A < 3/3/i. One easily gets that 


and 





p \ 

3/3 - pj 


r(4/3-p)(l-e-'^‘) 
53(6 = < . 27 (4/3-p)" 

r 256 (3/3 -p)3® 

and for t < ts, 52(6 = 0 and if t > t^, 


— Afit 


if t < ta, 
if t > ta. 


Finally si{t) = xo(t) = 0, for all t > 0. Figurepresents a case with d = 4 and 
where, asymptotically, a local equilibrium holds: files have either 2 or 3 copies as t 
goes to infinity. 
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Figure 2. Fluid Limits of an Overloaded Network, 2/3^<X<3j3fj, 
with d = 4, ^ = 0.1, A = 0.22, (3 = 1. In this case = 5.23. 


4. Evolution of Stable Network 
In this section, the asymptotic properties of the sequence of processes 

are investigated under the condition p = X/^ > d(3 and with the initial state 
X^(0) = (0,..., 0, Fjv). Sectionjsjhas shown that, in this case, the system is stable 
at the first order, i.e. that the fraction of lost files is 0. This does not change 
the fact that the system is transient with one absorbing state (F/v,0,... ,0). The 
purpose of this section is of showing that the decay of this networks occurs on the 
time scale t i-A 

The section is organized as follows, preliminary results. Lemma and Propo¬ 
sition partially based on couplings show that the coordinates in the middle, i.e. 
with index between 1 and d — 1, cannot be very large on any time scale. In a second 
step. Proposition!^ and Propositionshow that the flows between the coordinates 
of the Markov process are “small”. Proposition is the crucial technical result of 
this section. Finally, the asymptotic study of a random measure on N x K+ gives 
the last element to establish the main result. Theorem on the evolution of the 
network on the time scale 1 1 —>■ 


Stochastic Differential Equations 

The SDE satisfied by the process {X^{t)) are recalled. As before, if 1 < fc < d. 
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(^) = ^li^) + ■ ■ the convention that Sq = 0 and S^i = — 1, then 

(15) X^{t) =f, f X^iu) du + 

Jo 

(16) X^{t) = [ X^^,iu) du-fik [ X^{u) du 

Jo Jo 

+ ^{Sf_,M= 0 .X«,(«)> 0 } d«)=o.xf(«)>o} dw 

+ M^{t), for 1 < fc < d — 1, 

where, for 0 < /c < d—1, {M^{t)) is a square integrable martingale whose previsible 
increasing process is given by 

(17) {M^) {t) = f X^ {u) du, 

Jo 

(18) (Mf) (t) = ^x{k+l) [ Xf+i(u) du + fxk [ X^{u) du 

Jo Jo 

4.1. Some Technical Results. We start with two preliminary results on a cou¬ 
pling of the network. 

Lemma 1. If {L[t)) is the process of the number of customer of an M/M/\ queue 
with arrival rate a and service rate 7 > a and with initial condition L{0) = xq G N 
then, for the convergence in distribution of continuous processes, 

lim (^ [ Liu) = ( ^^t] . 

N^+ooyNJo J \j - a J 

Proof. The proof is standard, see the end of Proof of Proposition 9.14 page 272 of 
Robert for example. □ 

The next proposition presents an important property of the network. Roughly 
speaking it states that the Fj^ files have either 0 or d copies on the time scale 
t I—)■ N‘^~^t. Coordinates with index between 1 and d — 1 of the vector {X^(t)) 
remain small. 

Proposition 2 (Coupling). Under the condition djdp. < A and with the initial state 
X^{0) = (0 ,..., 0, Fpf), one can find a probabilistic space so that the relation 

id - l)Xf (t) + (d - 2)Xf (t) + • • • + X^i(t) < LoiNt), Vt > 0, 

holds, where the vector (Af^(t),l < k < d—1) has the same distribution as the 
state of our network and (Lo(0) ^^6 process of the number of customers of an 

M/XI/1 queue with arrival rate dp,fio and service rate X and with the initial condi¬ 
tion Lo(0) = 0 for some fio satisfying dpcfio < A. 

For all i = 1, 2, ..., d—1 and a > 0 then, for the convergence in distribution of 
continuous processes, the relation 


X^iN<^-^t) 
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Proof. The existence of Nq and /So such that dfj,Po < A and Fjv < /3oN for N > Nq 
is clear. Define 


Z^it) = {d- + {d- 2)X^{t) + .. • + Xt,{t), 


then the possible jumps of {Z^(t)) are either 1, —1 or —(d—1). If X^it) = (xk), 
jumps of size 1 occur at rate ijl[ 2 x 2 + • • • + (d — \)xd-i + dxd\ < fidF^ < fid/doN. 
Similarly jumps of size —1 occurs at rate XN provided that Z^(t) 7 ^ 0. A simple 
coupling gives therefore that {Zjq(t)) is upper bounded by an M/M/1 queue with 
service rate XN and arrival rate fid/doN. The first part of the proposition is proved. 

By ergodicity of the M/M/1 process {Lo{t)), one has, for the convergence in 
distribution, 


( 20 ) 


lim 


N —¥-\-00 


( Lo{NH) \ 
\ J 


= 0 


for all K > 0 and a > 0. Indeed, if 


Tk = inf{s > 0 : Lo{s) > K}, 

then, if d = d/i/3o/A, the random variable S^Tx is converging in distribution to an 
exponential random variable as K goes to infinity. See Proposition 5.11 page 119 
of Robert [5T] for example. 

For T > 0 and e > 0, one has 


and since d < 1, this last term is converging to 0 as goes to infinity. Conver¬ 
gence (1^ has therefore been proved. One concludes that the sequence of processes 
converges in distribution to 0. The proposition is proved. □ 


Proposition 3. Under the condition d/3p, < A and if X^(0) = (0,..., 0, Fx), then, 
for 1 < k < d — 1 and any 7 > 0. one has 


( 21 ) 


lim 

N^OO 




iV^+T 


Xk (u) du 


= 0 . 


for the convergence in distribution of continuous processes, and, for any t > 0, 


( 22 ) 


1 


1 ™ , 
AT-i-oo Arfc+7 


/ E {X^{u)) du = 0. 
do 


Proof. One proceeds by induction on 1 < k < d — 1. 


tion (15) gives the relation 


(23) 


1 


^iVl+7 


Xi (u) du = 


'0 


iVl+7 

by Doob’s Inequality and Equation (|17|), for e > 0, 


|M„"(iV^-U| ^ ^ 

\o<u<t 


Let fc = 1, if f > 0, Equa- 

M^{N'^-H) 


< 



Af'(Af“'-iu) du 


1e 

^2 ]V2+27 J 
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by using again Equation (23). The variable being upper bounded by F^, the 
last equality shows that Convergence (22) holds in this case. Additionally one gets 
that the martingale term of Equation (23) vanishes at infinity. The convergence (21) 
is therefore proved. Induction assumption is thus true for fc = 1. 


Assume by that induction assumption holds up to index k<d—l. Equation (16) 
gives 




(24) I 


]Yfc+l+7 


aw j^fk+i+j + Nk+i+'r 






Xk (u) du 


7Vfe+7 


A * 

7Vfc+7 


^{sf_i(«)=o.x«(K)>o} aw jvfc+i+7 ■ 


Note that, for j = fc — 1, fc 
A 




]\fk+~f 


^{sAi(“)=OAf(«)>o} - jyfc+7 


X^ {u) dw. 


By integrating Equation (24) and using the induction assumption, one obtains that 
Convergence (22) holds for k + 1. Back to Equation (24), by induction again, 
the first four terms of the right hand side of Equation (24) converges to 0 and 
the martingale term vanishes since the expected value of its previsible increasing 
process is converging to 0 by Relation (18) and Convergence (22) which has been 
established. □ 

Proposition 4. Under the condition d/dfu, < A and if X^{0) = (0,..., 0, E/v), then 
the relations, for 1 < k < d—2, 


(25) 


lim 


1 


‘ [{k + l)/rXf+i(u) - XNX^iu)] du j = 0 


A^—doo \ 

holds for the convergence in distribution of continuous processes. 


Proof. One proves Convergence (25) for 1 < fc < d — 2. With the evolution equa¬ 
tion (16) and the same notation as in Section for the Poisson processes, for 
any function / : N —?► K+, one has 


rt r 


f (Af (t)) =/ (Af (0)) + / / (Af (u-)+l) -/ (Af (u-)) 


'0 ■- 




ij.ik+i)xf (dw) 


rt r 


/o ■- 


/(Af(u-)-l)-/(Af(u-)) 




fikXi 


r (du) 


+ / / (-^^(w-)+l)-/(Af (u-)) l{s«_^(„_)=o.xf_,(K-)>o}-^->'^(du) 

0 

+ f f {^k (w—) — l) —/ (A^ (w—)) A/AAr(du). 
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By taking f[x)=x^ and by compensating the Poisson processes, one gets the relation 

(26) / (2Xf (r) + l)X^+,{u) du 

Jo 

+ /ifc/ {-2X^iu) + l)X^iu)du 
Jo 

+ XN {2X^{u) + du 

J 0 

+ / (-2X^ (u) + l)l{sf_i(ii)=o.Y«(«)>o} 

«/ 0 

The process is a martingale with a previsible increasing process given by 


Pl\ I 

(27) W = Kk+1) / (2Xf (u) + l)2xf+i(u) du 

+ ^ik r \-2X^^^{u) + Ifx^iu) du 
Jo 

+ [ (- 2 ^^(m) + («)>o} 

'J 0 

By adding up Equations (16) and (26), after some straightforward calculations, one 
gets 


(28) X^{N‘^-H)+X^{N‘‘-Hf=2 [^l{k+l)X^^,{u)-XNX^{u)]du 

Jo 

+ 2^i{k+l) / Xf (u)Xf+i(u) du - 2^ik / Xf (u)2 du 
^0 Jo 

pN^-^t 

+ 2XN / {X^ (u) + l)l{sN_^(„)=o,xf_i(ii)>o} 

'J 0 




+ 2XN 


X, 


r('“)l{sN_^(„)>o,jc«(„)>o} dw + (t) + 


It will be shown that, when this relation is scaled by the factor except the 

first integral in the right hand side, all terms of this identity vanish as N gets large. 
The proposition will be then proved. 

For the terms of the left hand side this is clear. For l<k<d—2 and jG{k, fc+1}, 
the relation 


1 


/ (u)Xf (u) du 

Jo 


^/c+ 1/2 


< sup 

0 <'u<t 


'xf(iV'^-iu)\ 1 


"iVl/4 


J^k+l/A 


X^ (u) du. 










20 


WEN SUN, MATHIEU FEUILLET, AND PHILIPPE ROBERT 


and Propositions and show that the second term of the right hand side of 
Equation (28) scaled by vanishes for the convergence of processes when N 


gets large. By using the inequalities 


/*iV“ nN^ 


and 




X 


N 




k-l 


(«)> 0 .A«(' 


d>o} ^ H 


X^^{u)X^{u) du 


JO 


i=l 


the same property can be established in a similar way for the third, fourth and fifth 
terms. 

By using Equations (18) and (27) and similar methods one gets that for any 
t > 0 , 


IV-f+oo jV-f+cxD 




_/V2fe+l 


= 0 . 


Doob’s Inequality shows that the martingale terms of Relation (28) scaled by 
]^k+i /2 fQp convergence of processes when N gets large. The propo¬ 
sition is proved. □ 

Proposition 5. Under the eondition dj3n < A and if X^(0) = (0,..., 0, Fpj-) then, 
for the convergence in distribution of continuous processes, the relations 
(29) 


N 

and 

(30) 

hold. 


hin^ ‘ X^iu) du - Xf_,{N‘^-^u) dw^ ^ = 0 


lim 

AT—>-+oo 


Xo^(iV'^-H) ^(d-l)! 


N 


nd-1 


X^_,{N‘^-\) du =0 


Proof. By Relation (25), one gets that, for the convergence in distribution of con¬ 
tinuous processes, 

AttAu) XAIn.) 

du 




lim ( Vn \ [ 

N-J.+00 I Wq 


V 


iV*^+i 


Nk 


holds for 1 < A: < d — 2 , and therefore that 


(fc+l)!X,Ai(u) k\ X^{u) 

pk+l jyfc+l pk ]\[k 


hm (VnIT 
A-J.+00 y \^Jq 

By summing up these relations, one finally gets that 

^ I ‘ 

N^-\-oo \ \ 


du 


= 0 , 


= 0 . 


1 1 /-I J„ A A 


vN 


Xl(u) 

N 


du 


= 0 . 


Relation (29) is proved. 
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SDE (15) for {XQ{t)) gives the relation 


N 


N 


L 

N 




Xf'(M) du, 


where {N‘^ ^t)/N) is a martingale whose previsible increasing process is given 

by 



Xf^(u) du 


it is converging in distribution to 0 by Proposition!^ one concludes that the mar¬ 
tingale is also converging to 0. The proposition is thus proved. □ 


We now turn to the proof of an averaging principle. It relies on the martingale 
characterization of Markov processes as used in Papanicolau et al. [M] in a Brownian 
setting, see also Kurtz m- 


4.2. Convergence of Occupation Measures. For a; G N and X > 1, the random 
measure on K+ is defined as, for a measurable function g : K+ —>■ K+, 

Clearly is the random Radon measure associated with the local time of {X^_^{t)) 
at X. For a given x, the sequence {A^) of random Radon measures on IR_|_ is tight. 
See Dawson O Lemma 3.28, page 44] for example. Note that the null measure can 
be a possible limit of this sequence. By using a diagonal argument, one can fix (N^) 
such that, for any cc G N, is a converging subsequence whose limit is I'x- 

Since, for iV > 1, A^ is absolutely continuous with respect to the Lebesgue 
measure on K+, the same property holds for a possible limiting measure Vx- Let 
(x,t) —>■ Trt{x) denote its (random) density. It should be remarked that, one can 
choose a version of Trt{x) such that the map {uj,x,t) —>■ Trt{x){uj) on the product 
of the probability space and N x IR_|_ is measurable by taking Trt{x) as a limit of 
measurable maps, 

TTt{x) = limsup -Vx{[t,t + s]). 

s —>-0 S 

See Chapter 8 of Rudin [53] for example. See also Lemma 1.4 of Kurtz [T3|. One 
denotes by tt^ the measure on N defined by the sequence {TTt{x),x G N). 

Proposition 6. For any function / : N —>■ K+ such that the sequence {f{x)/x) 
is bounded then, with the subsequence {Nff) defined above, for the convergence in 
distribution of continuous processes, 

»“fG (sL / ' ’ '“*) ■'“) “ {L *'“■ ’ 

In particular, almost surely, for all t > 0, 
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Proof. Denote K = sup{f{x)/x : cc > 1} and 

it) = f {X^-iiu)) du, 

the stochastic domination results of Proposition gives that, for any 0 < s < t, 
d/f it) - d/f is) < ‘ Loiu) du, 


where (Lo(t)) is the process of the number of customers of an M/M/1 queue with 
arrival rate d/r/3o and service rate A for some convenient /?o such that < A and 
with the initial condition Lq{0) = 0. The convergence result of Lemmaimplies 
then that the sequence of processes (t)) is tight by the criteria of the modulus 
of continuity. 

For C > 1 and t > 0 


J^d-1 fi^d-li'^))'^/xf_^(u)>C} - j^d-1 

K 

-wjo ^oi^^'^{I^o(u)>C} du. 

The last term is converging in distribution to iFtE(Lo)l|Lj,>c|)i where Lq is a 

random variable with geometric distribution with parameter d^jd^/X, the invariant 
distribution of the process (Lo(0)- In particular for T > 0, if C is sufficiently large, 
this term can be made arbitrarily small uniformly for t <T. 

By using the fact that, for a; S N, 

p pN‘‘-~^t 

fiXd-iiu))l{xf_,iu)=x} du = fix) (A^, l[o,t]) , 
one gets the desired convergence in distribution. 

□ 


4.3. The Decay of the Network occurs on the Time Scale 1 1 —We 

have all the necessary technical results to prove the main result concerning the 
behavior of the system on the time scale 1 1 —)■ 

Theorem 2 (Rate of Decay of the Network). Under the condition d/3/r < A and if 
A''^(0) = (0 ,... ,0,Fx), then the sequence of processes {X^{N'^~^t)/N) eonverges 
in distribution to (4?(t)) where, for t > 0, $(t) is the unique solution y € [0,/3] of 
the equation 




p/d 


e^ = exp 


-A 


(d-1)! 

r,d-l 



(31) 
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Proof. Let / be a function on N with finite support then, the SDE (161 associated 
to the evolution eqnations give 

fiX^,{N^-H)) - /(O) - 


Nd 






X^iN^^-^u) 


N 

X^_,{N<^-^u) 

N 




du 


+A1 


{S«_2=0.Y«_,(Ar‘i-i«)>0} 


du, 


where A+(/)(a;) = f{x+l) — f{x) and A“(/)(ai) = f{x—l) — f{x). The convergence 
of the various components of this identity are now examined. 

Clearly enough, / being bounded, the process {[f{X^_^{N‘^~^t)) — f{0)]/N‘^) 
is converging in distribution to 0 as A gets large. By calcnlating the previsible 
increasing process of the martingale {M ^it is not difficnlt to show 
that this process vanishes at infinity. 

Note that 

[ '“))^{s~_3=o.A:”_2(iV‘i-iu)>o} 

0 

pt 1 pN^ 

<2\\fUj^ X^_,{N^-^u)du = 2\\f\\^^ I X^_,{u)du, 

the process associated to the last term is converging in distribution to 0 by Propo¬ 
sition!^ Similarly, 


0 

d-2 .t 

<2ii/iui: / Xk{N^ ^u) du 
Jo 


and the last term is also converging to 0 in distribution. In the same way 


' A -du 


<2||/||c 


'■* X^_, {N^-^u) 
N 


du 


which converges to 0 by the last assertion of Proposition 

To summarize, we have proved that the following convergence in distribution 


(32) du 

+ du) = 0 . 

By using again Propositions and one gets that the convergence of the se¬ 
quence of processes is converging to a continuous process (d>(t)) such that 


def. ,. I X^^iNth) 


($(t)) =• lim 

JV-!. + oo 


Nk 


= A 


(d-1)! 


r,d-l 


1 , 1 ) du 


where I{x) = x for x > 0. By the Skorohod representation theorem, one can 
take a convenient probability space such that, for all x S N, this convergence also 
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holds almost surely as well as the convergence of the processes , l[o.t]))- The 

identity 

X^{N^-H) _ Fn XoiN‘^-H) _ g X^{N^-H) 


N N N 

and Equation ( [3^ give that the relation 

rt 




N 




- ^(M))A+(/)(a;) + Al{a;>o}A {f)[x) 


du = 0 


holds almost surely for alH > 0 and all functions f = fk, k > 0 with fk{x) = Ifc(x) 
for a: e N. One concludes from this relation and Proposition]^ for u G K+ outside 
a set S negligible for the Lebesgue measure, one has for all fc > 0 




xGN 


dfJ-iP - <^{u))A+{fk){x) + A1{2 ,>o}A {fk){x) 


= 0 


and 7r„(N) = 1. Hence, if u S 5, (7r„(a;)) is a geometric distribution, the invariant 
distribution of an M/M/1 queue with arrival rate — $(«)) and service rate A. 
The definition of $(t) gives therefore the fixed point equation, for all t > 0, 

'•* d/r(/3-$(«)) 


(33) m = I 

one gets the relation 

p/d 


0 X-dniP - <^{u)) 


du, 


p ) 


= exp ( -A 


nd-l 


The theorem is proved. 


□ 


One concludes this section with the asymptotic of the first instant when the 
network has lost a fraction 5 G (0,1) of its file. It generalizes Corollary 1 of Feuillet 
and Robert [3]. This is a direct consequence of the above theorem. 

Corollary 2. If, for 6 G (0,1), 


Tn{5) = inf t > 0 : 


N 


> 5/3 


then, under the condition A > dj3/jL, the relation 


lim 


Tn{5) 




N^+oo A((i-1) 

holds for the convergence in distribution. 


(^log(l-5)-/35) 


5. Second Order Asymptotics in the Stable Case 

This section is devoted to the study of the second order fluctuations associated 
to the law of large numbers proved in Theorem As it will be seen the proof 
relies on careful stochastic calculus, technical estimates and Proposition proved 
in Section m 

Notations 

— If {Y^{t)) and {Z^{t)) are sequences of stochastic process, with a slight 
abuse of notation, we will write Z^it) = Yi^{t) + Od{l) when the sequence 
{Zi^{t) — Y^/t)) converges in distribution to 0 when N goes to infinity. 
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Lemma 2. Let 

then {Yj^-^^{t)) converges in distribution to 0 as N goes to infinity. 

Proof. By using the SDE satisfied by the process {X^_^{t)), as in the proof in 
Proposition]^ one gets 


]\fd-l/2 


jgd-1/2 


jgd-l/2 _/yd-l/2 


2 

fifidXlj2 


Pl\ I 

'X 0 

-X^_,{u){{d-l)X^_,{u) - AiVl|^„ 


dw 


rN^ 


JSfd-1/2 


[iX^_Au) + l)dtdX^{u) - XNX^_,iu)] du 


where and ^i^)) the associated local martingales. The pro¬ 

cesses of left hand side of this relation vanishes as N gets large due to Proposition]^ 
With similar arguments as in the proof of Proposition]^ one obtains that the mar¬ 
tingale terms and the first integral of the right hand side vanish too. This is again 
a consequence of Propositions ]^ and ]^ 

Therefore, the last term 


1 




[(X,^_i(u) + l)dyiX^{u) - XNXtM)] 


\Nd-i/2 

converges to 0 in distribution when N gets large. The lemma is proved. 


□ 


Theorem 3 (Central Limit Theorem). If dfifiKX and if Condition @ holds and 
the initial state is X^ fiS) = (0,..., 0, Fn), then the following convergence in distri¬ 
bution holds 


lim 

AT—>-+oo 


X^{N‘^-H) - Nd>{t)\ 


y/N 


= {W{t)), 


where $(t) is the solution of Equation (31) and the process {W{t)) is the solution 
of the stochastic differential equation 

(34) iww =v^di3(4) - ^ d., 

with Wo(0) = 0, where {B{t)) is a standard Brownian motion and ^(t) is the unique 
solution of Equation (HTj). 

Proof. We denote by 


X^{N‘^-H) - Nd>{t) 


X^{N'^-H) - N{p - $(t)) 


W^{t) = ° ^ ^ ^ ^ and W^{t) = ^ 

The strategy of the proof consists in starting from the convergence proved in the 
above lemma to write an integral equation for the process (ITj'^(t)), this is Equa¬ 
tion (37) below. Technical results of Section ]^ are used repeatedly in the proof 
of this identity. The last part of the proof consists in proving the tightness and 
identifying the possible limits of this sequence. 
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The total sum of the coordinates of being Fjv, scaling Condition 0 

and Relation (19) of Proposition give the identity 

(35) - m) F^-_N(3 g (N'^-^u) 


y/N 




k=l 
tN, 


^/N 


The SDE (15) gives the relation 


X^{N‘^-h) =PL [ X^{N‘^-^u)N^-^ du + 

Jo 

The previsible increasing process of the martingale {Mq /'/N) is given by 






Xi {u) du , 


and it is converging in distribution to (<i)(t)), see the proof of Proposition]^ Con¬ 
sequently, by using Theorem 1.4 page 339 of Ethier and Kurtz [5] for example, for 
the convergence in distribntion of processes, one has 


lim 


Af—>-1-00 y ^/N 




y^) di?(n)) (B($(t))), 


where is a standard Brownian motion on K. 

Let 

ft 


HN{t) = [ X^_,{N‘^-\) du, 

Jo 

Relation (29) of Proposition shows that 

r‘ d„+o,(i) 

P‘^~^ Jo N 


holds and SDE (15) gives 


fN'^-H 


(m) dw = X^{N‘^-H) - 
Jo 

= iv$(t) -h Vxw^it) - 

One obtains therefore the following expansion for 


(36) Vn {- ci>(t)) = W^{t) - ^ 


l-DI 

V 

Lemma gives the relation 
1 


y/N 


[ [{X^_,iN‘^-^u) + l)dtiXS^- XNX^_,iN‘^-^u)] du = 0^(1), 
Jo 
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which can be rewritten as 




X^iN^-^u) 


N 


-{/3- «>(«))) dw 


+ Vn f X^_^{N‘^-\) {dfi{/3 - $(u)) - A) du 
+ d^l^/N {l3-^{u))du + dn^ (Xf - Af(/3 - $(u)) du = 0^(1). 

If one plugs the integration by part 

f X^_,{N^-^u) [X - dfxiP - $(«))] du 
Jo 

= [X — dfi{P — — dfi ( {u) 

Jo 

into this identity, this gives the relation 

d^i f X^_,{N‘^-^u)W^iu)du 
Jo 

— ■\//Vi?Ar(i) [A — d/r(/3 — <I>(t))] + d/r j VNHN{u)^'{u)du 

Jo 

+ dfiVN [ {l3-d>{u))du + dn [ (u) du = Od{l). 

Jo Jo 

The expansion (36) for {y/NHN{t)) yields 


d^J, X^_^{N‘^-\)W^iu)du + VNAN{t) 


P 




A(d-l)! 

^d-i 

f d^i 




A(d-l)! Jo 


Vn 

W‘^u)- 




y/N 


[X-d^J,i/3 - d>{t))] 
$'(u) du 


+ d^l f Wj^{u)du = Od{l) 
Jo 


with 


J^N{t) = [X - dn{/3 - $(t))] + d^i J $(u)$'(u) du 

+ dfi f (/3 —$(u))du 

Jo 

[X — dfj,{P — $(u))] <i>'(u) du + d/i / (/3 — $(u)) du 

Jo 


A(d-l)! Jo 


= 0, 
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by Relation (33). By using Equation (35), one gets finally the relation 

(37) -dn f X^_^{N‘^-^u)W^{u)du + dfi-f f X^_^{N‘^-^u) du 
Jo Jo 


p 


d-1 


X{d-1)\ 

^d-1 

f 




Vn 


Hd-iy. Jo 




Wo^iu)- 


//V 


[X - dfi{l3 - ^t))] 
$'(u) du 


— d^i f (u) du + d^jt = OdO)- 
Jo 


Starting from the above equation, one can now complete the proof of the theorem 
in four steps. 

(1) Local boundedness. 

By using the convergence in distribution of [Mq {N'^~^u)/y/N) and Gron- 
wall’s Inequality, one gets that, for e > 0 and T > 0, there exists some 
K > 0 and A^o such that if > TVoi then 


(38) 


sup \Wj^is)\>K] <e. 

0<s<T 


(2) Tightness. 

One first note that the two sequences of processes 

^ XjJ^{N‘^-\)du^ and XjL^{N‘^-^u)Wj^(u) du 

satisfy the criterion of the modulus of continuity: for the first sequence this 
is a consequence of Proposition and Theorem Relation (38) and the 
fact that, for 0 < s < t < T, 

f Xj^_,{N‘^-^u)Wo^{u)du <{ sup IIEo'^(u)l) f XjJ_^[N^-^u)du, 

Js \0<u<T J Js 

give this property for the second sequence. As it has been seen this is also 
the case for {MJ^{N'^~^u)/'/N). Relation (37) can thus be rewritten as 


(39) 


Wo^{t) + f Wj^{u)F{u) du = 
Jo 


where {F{t)) is a deterministic continuous function and {F[^(t)) is a se¬ 
quence of processes which satisfies the criterion of the modulus of continu¬ 
ity. As before, See relation (Hi, denote wz as the modulus of continuity 
of the process {Z{t)) on [0,T], Relation (39) gives the inequality. 


WwiV < -h(5||F||oo sup |Wo (s)l 

“ 0<S<T 


with ||E||oo = sup(|F(s)|,0<s<T). One deduces the tightness of (ITo^(t)) 
by the criterion of the modulus of continuity. In particular any limiting 
point is a continuous process. 
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(3) Convergence of the first term of Equation ( |^ . 

Let {W{t)) be a limit of some subsequence By Skorohod’s rep¬ 

resentation theorem, on can assume that the convergence 

<■(«)) = 

holds almost surely for the uniform norm on compact sets of IR+. If / is a 
function, by integration par parts, one has the convergence 

il i-'WM d"). 

which can be extended to any arbitrary continuous function / by a regu¬ 
larization procedure. Since 

- W{u)) du) = 0, 

one finally gets the convergence 

(/’v£(ivr‘..)<‘(.) d.) = d.), 

(4) Identification of the limit. 

A possible limit {W{t)) satisfies therefore the integral equation 


— dfj, 


( P' 


d-l 


'o VA(d-l)! 


$'(u) -I-1 ) IE(u) du -I- dj 


r>d-2 


(d-l)! 


m 




A(d-l)! 




„d-l 


dfi- 


A(d-l)! Jo 

and, with Relation (|33|), it can be rewritten as 


{W(u) — B{^{u))) $'(u) du -I- dfiji = 0, 


— Xdfj, 


W{u) 


'o A - (/3- $('u)) 
^d-1 r 


du + d'y 


P 


d-2 


(d-iy. 


$(f) -I- dfi'yt 


A(d-l)! Jo 
The theorem is proved. 


[A — d^{/3 — 4>(u))] ^dlE(u) — \/ $'(u) di3(u)^ = 0. 


□ 


6. A Local Equilibrium in the Overloaded Case 

We have seen in Corollary[^that if for some 2 < p < d, one has p/3 < p < {p+l)/3 
and if the initial state is AAr(O) = (0,..., 0, EV) then one has the convergence in 
distribution 


and 


lim {xp(t),Xp+iit)) = {{p+l)/3 - p,p-pl3). 

t —>-+oo 


The system started with ^j3N files with d copies and it ends up, on the normal 
time scale, in a state where there are still /3N files but with either p or p-|-1 copies. 
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Figure 3. Stable Asymptotic Fluid State in an Overloaded Net¬ 
work with pPh < X < {p + l)/3/r for some 1 < p < d 


In this section we start from this “equilibrium”, Proposition shows that this 
fluid state does not change on the time scale t i—>■ NP~'^t. Theorem proves that, 
on the time scale t i—>■ a positive fraction of files are lost. It is also shown 

that the number of files with p copies decreases to end up in a state where, for the 
fluid state, there are only files with p+1 copies. 

One starts with an elementary result concerning the M/M/oo queue. 

Lemma 3. If {LN{t)) is the Markov process associated to an M/M/oo queue with 
arrival rate XN and service rate p, and initial condition such that 

y Aiv(O) A 
1 ™ ——— = -, 

N—>- + oo N /i 

then, for any S N, the convergence in distribution 

ii„ 

AT—>+oo \ N J p, 

holds. 


Proof. For e > 0, by bounding the rate of jumps —1 of the process, a coupling can 
be constructed such that 


— i.P 


holds for alH > 0, where (Zjv(t)) is an M/M/1 queue with input rate A and service 
rate A -I- pe, with initial condition LjsiifS) = 0. If tjv = inf{t > 0 : > eN} 

then. Proposition 5.11 page 119 of Robert [H], gives that for any i> 1 and x > 0, 


lim P(rjv < N^x) = 0. 


lim ] 
N—>--\-oo 


^ sup 
Vo<i<T 


N 


= 1 . 


With a similar argument for a lower bound one gets finally the convergence in 
distribution, for any ^ > 0, 


hm -—- = p. 

AI—f+oo N 


The lemma is proved. 


□ 


One shows in the next proposition that the fluid state of the network does not 
change on the time scale 1 1 —>■ NP~^t. 
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Proposition 7 (Stability of Local Equilibrium on the time scale t i-A If 

for some 2 < p < d, one has p/3 < p < {p + l)/3, and the initial state is such 

that = 0 for 1 < i < d, i ^ {p,p + 1} and 


lim 

N—¥-\-00 


X^iO) 


= {ip+l)l3 - p,p- pI3) 


N ’ N 

then for any q < p — 2, for the convergence in distribution, 


lim 

A^—>-+00 


N 


N 


= {{p + l)P - p, p - p/3) 


Proof. Clearly it is enough to show the proposition for q = p — 2. Let 

p-i 

Z^{t) = J2{p-k)X^(.t). 




then, if (t) = z, there is a jump of size +1 for at rate 

p 

P Z (t) < PPPX, 

k=2 

and of size —1 at rate \N if z > 0. In the same way as in in the proof of Proposi¬ 
tion one can construct a coupling, for which 

Z^it) < Lo{Nt), 

where {Lo{t)) is a stable M/M/1 queue with input rate ppfi and output rate A. In 
particular, the convergence in distribution 

'XI^{NP-H)' 


(40) 


holds. 


lim 

N—>-+oo 


N 


= 0 , — 1 , 


Because of Relation pp/3 < A, one can extend the results of Propositions!^ and 
to get that, for 1 < fc < p — 2, 


lim 

N—^OO 



{k + 1)! X^j^.^{u) 

k\ X^/u) 

[Jo 

pk-\-\ 

pk jyk 


du = 0 


holds for the convergence in distribution. By summing up all these relations for 
1 < fc < p — 2, one gets 


lim 

N^+oo 1 pP-1 NP- 


I p 

^ Jo J 


X^{u) 
N 


dw =0. 


Relation (40) gives the convergence in distribution 


lim 

N—>--\-oo 


N 


consequently 


lim 

A^—>- + oo 


X^/np-H) 


N 


du = 0, 


= 0 , 


by using the SDE associated to (Xq (t)) as in the proof of Proposition]^ 
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One concludes that 


(41) 


lim 


A^—>-+oo 





= /3 


Let 

Y^{t)=J2kX^{t), 

fc=i 

then, if (t) = y, there is a jump of size —1 for Y^ at rate y,y, and of size +1 
at rate XN if X^{t) + • • • + (d — l)X^_-^{t) > 0. Hence, in the same way as in the 
proof of Proposition]^ a coupling can be constructed such that the process {Y^{t)) 
is dominated by the process (L 7 v(t)) of the number of customers in an M/M/oo 
queue with arrival rate XN and service rate A, and with initial condition such that 


lim = pUp + 1)13 - p) + {p+ l){p - p/3) = p. 

Af-j'+oo iV 

By using the relation 

kX^{t) + pX^it) + (p + 1) j ^ xf (t) - X^it) 

k—1 \k—p 


j < Y^{t) < 


Equations (40) (41) and the above lemma, one gets that, for any e > 0 and T > 0, 

X^{NP-H) 


lim P inf 

N^-\-oo \ 0<f<T 


N 


>{P+1)I3 - p- e \ =1. 


Relation A < (p + l)/3p, gives that {X^ {N^ ^t)) is strictly positive on any finite 
interval with high probability. Consequently, 


lim 

N—¥-\-(X) 


[ inf 
\0<t<T 


x^{NP-h) + • • • + (d - i)x^i 


(iVP-2 



= 1 


this implies that the two processes {Y ^and {Lpf{NP~'^t)) are identical 
with probability close to 1 when N is large. Secondly, since the duplication capacity 
cannot be used at any node with index greater than p + 1, for any p + 2 < fc < d, 
for the convergence in distribution, the relation 


lim 

N—^-\-oo 


x^{NP-H) 


N 


= 0 


holds. One deduces therefore the convergence in distribution 

'pX^{NP-H) + (p + 1)X^^^{NP-H) ^ 


lim 

N—^-\-oo 


N 


= P 


( x^ {np-H) + x^^^{np-H) \ 

N—>+oo \ N j 


The proposition is proved. 


□ 


We can now state the main result of this section. 
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Theorem 4 (Evolution of the Local Equilibrium). If for some 2 < p < d, one 
has pf3 < p < {p + 1)13, and the initial state X^{0) is such that (0) = 0 for 
1 < i < d, i ^ {p,p + 1} and 


lim 

AT—>-+oo 


x^io) 

N ' N J 


{{p + l)(3 - p,p- p(3) 


then, for the convergence in distribution, 
fNP-^t) X^{NP-H) 


lim 

N—^-\-oo 




vN 

^p+l 


(lVP-4)' 


N 


N 


N 


($o(t),$p(0,^P+lW) 


where, for t > 0, 


^p{t) = iP+l){l3 - $o(i)) - P and $p+i(t) = p - p{(3 - 4'o(<)) 
and 4>o(^) is the unique solution y of the fixed point equation 


(42) 

In particular, 

(43) 


1 - 


/3 - p/{p + 1) 


p/(p(p+i)) 


eP = exp ( -X^^-^t 


nP-i 


lim (4>o(t), $p(t), <^p+i{t)) = {/3- 




p+1 p+1 


Remark. Relation ( [4^ shows that a fraction j3—p/{p-\-l) of the files is lost asymp¬ 
totically on the time scale 1 1 —>■ NP~^t. The corresponding asymptotic state consists 
then of files which are either lost and, at the first order in N, p/{p+l) ■ N files with 
p-l-1 copies. This suggests that f3 is changed to I3'=p/{p+l) and p replaced by 
p'=p+l. Unfortunately, this is the case of equality fl' =p'p which is not covered by 
our theorem. This suggests nevertheless the following evolution on the time scale 
t I—)■ N’^t, p—l<q<d—2, for t going to infinity, there remain p/{q+2)N files alive 
with q+2. Some of the files are therefore lost and the number of copies of the 
remaining files is increasing, until the maximum number of copies is reached which 
is the framework of Section |4l 


Proof. The proofs use the same arguments as in the proof of Theorem and of the 
above proposition. We give a quick overview of it. By using again the results of 
Propositions 1^ and and Relation (25), one gets that, for 1 < fc < p — 2, 


lim 

N—>oo 



{k + 1)! Ar^^(M) 

k\ X^{u) 



pk j^k 


du = 0 


holds for the convergence in distribution. By summing up all these relations for 
1 < fc < p — 2, one gets 


lim 

N—^-\-OC 


(p-1)! 1 

pp-i NP- 


rNP- 


Xp_i{u) dw - 


P 


rNP- 


^r(u) 

N 


dw =0. 


Erom there one gets that 


lim 

N—>-+oo 




(p-1)! A 


rN^- 


Xp_i{u) dlt = 0. 


N pP-i NP-^ Jo 

As in the proof of Propositionj^ one can define a similar {'i'J(t)) and prove the same 
stochastic averaging property associated to the coordinate {Xp{t)). The rest of the 
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proof is then similar to the proof of the last proposition with /3 replaced by ,5 — (j){t) 
where is the limit of some converging subsequence of {X^{NP~^t)/N). The 

convergence follows from the uniqueness of the fixed point equation satisfied by 

m))- □ 


Appendix A. Generalized Skorohod Problems 


For the sake of self-containedness, this section presents quickly the more or less 
classical material necessary to state and prove the convergence results used in this 
paper. The general theme concerns the rigorous dehnition of a solution of a sto¬ 
chastic differential equation constrained to stay in some domain and also the proof 
of the existence and uniqueness and regularity properties of such a solution. See 
Skorohod [21], Anderson and Orey [T], Chaleyat-Maurel and El Karoui |7] and, in a 
multi-dimensional context, Harrison and Reiman m and Taylor and Williams [21] 
and, in a more general context, Ramanan [T9[. See Appendix D of Robert [21] for 
a brief account. 

We first recall the classical definition of Skorohod problem in dimension K. If 

z = (zfc) S K*-, one denotes ||z|| = |zi| -I- |z 2 | H-h \zk\- If {Z{t)) = {Zk{t)) is some 

function of the set of cadlag functions defined on IR_|_ and P is a K x K 

non-negative matrix, the couple of functions [(A(t)), {R{t))] = [((Afc(t))), {{Rk{t)))] 
is said to be a solution of the Skorohod problem associated to {Z{t) ) and P whenever 

(1) X{t) = Z{t) + iI-P)- R{t), for all t > 0, 

(2) Xkit) > 0, for alH > 0 and 1 < fc < d, 

(3) For 1 < k < K, t ^ Rk{t) is non-decreasing, Rk{0) = 0 and 


Xk{t)dRkit) = 0 . 


In the important case of dimension 1, Conditions (1) and (3) are 
(1) X{t) = Z{t) + R{t), for all t > 0, 

(3) t —>■ R{t) is non-decreasing, R{Q) — 0 and 


X{t) dR{t) = 0. 


See Chaleyat-Maurel and El Karoui [7] and, in a multi-dimensional context, Harri¬ 
son and Reiman [10] and Taylor and Williams [26] . See Appendix D of Robert [21] 
for a brief account. The generalization used in this paper corresponds to the case 
when {Z{t)) depends on (A(t)). 


Definition 1 (Generalized Skorohod Problem). 

IfG : —>■ is a Borelian function and P a non-negative KxK 

matrix, {{X{t)), {R(t))) is a solution of the generalized Skorohod Problem (GSP) 
associated to G and P if {{X(t)), {R(t))) is the solution of the Skorohod Problem 
associated to G{X) and P, in particular, for all t > 0, 

X{t) = G{X){t) + {I-P)-R{t), 


and 


Xk{t)dRk{t)=0, 


l<k<K. 
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The classical Skorohod problem described above corresponds to the case when 
the functional G is constant and equal to {Z{t)). In dimension one, if one takes 

a(x(u)) dB(u) + / m{x{u)) du, 

Jo 

where {B(t)) is a standard Brownian motion and a and m are Lipschitz functions 
on K. The first coordinate {X{t)) of a possible solution to the corresponding GSP 
can be described as the solution of the SDE 

dX{t) = a{X{t)) dB(t) + m{X{t)) dt 

reflected at 0. 


Gix)it) = f 
Jo 


Proposition 8. If G : I?(]R+,K) —is such that, for any T > 0, there 
exists a constant Gt such that, for all (x{t)) € I?(]R_|_,K) and 0 <t <T, 

(44) sup IIG(x)(s)-G(j/)(s)II < Ct / \\x{u) - y{u)\\ du 

0<s<t Jo 

and if the matrix P is nilpotent, then there exists a unique solution to the generalized 
Skorohod problem associated to the functional G and the matrix P. 

Proof. Define the sequence {XN{t)) by induction {X^{t), R^{t)) = 0 and, for N >1, 
^AT+i) jg solution of the Skorohod problem (SP) associated to G{X^), 
in particular, 

(t) = F (X^) (t) + {t) and f X^+^ (u) dR^+\u) = 0. 

The existence of such a solution is a consequence of a result of Harrison and 
Reiman m- Fix T > 0. The Lipschitz property of the solutions of a classical 
Skorohod problem, see Proposition D.4 of Robert ED, gives the existence of some 
constant Kt such that, for all iV > 1 and 0 < t < T, 

II^N+l _ 11^ _ p ^ 

where ||/i||oo,t = sup{||ft.(s)|| : 0 < s < T}. From Relation ( |44| , this implies that 
II^AT+l _^Ar|| f ||X^-X^-H| dlt, 

M M oo.t — /II 11 oo,n ' 

Jo 

with a = KtGt- The iteration of the last relation yields the inequality 
||^7V+l _^Ar|| < /" ||XH| dw, 0<t<T. 

II lloo,r — jyl II lloo,u ’ — — 

One concludes that the sequence {X^{t)) is converging uniformly on compact sets 
and consequently the same is true for the sequence {R^{t)). Let {X{t)) and (R(t)) 
be the limit of these sequences. By continuity of the SP, the couple {{X{t)), {R{t))) 
is the solution of the SP associated to G{X), and hence a solution of the GSP 
associated to F. 

Uniqueness. If {Y(t)) is another solution of the GSF associated to F. In the 
same way as before, one gets by induction, for 0 <t <T, 

||x-r||^,< (^£||x-y||^_„ du. 
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and by letting N go to infinity, one concludes that X = Y. The proposition is 
proved. □ 
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